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Research  Findings 

In  this  report,  we  will  organize  the  reports  on  the  accomplishments  as 

•  Results  for  Interior  Point  Methods. 

•  Results  for  Optimization  with  Simulation  Constraints 

•  Results  for  Large  Scale  Nonlinear  Methods 

•  Results  for  Parallel  Direct  Search  Methods 


Research  on  Interior  Point  Methods 


Dennis,  Tapia,  and  Zhang  have  made  progre.ss  in  fast  primal-dual  interior-point 
methods  for  linear  programming.  The  work  done  under  this  contract  has  helped  explain  the 
role  of  phaseout  of  the  centering  step  in  the  speed  of  convergence  of  these  promising  methods. 

During  the  period  .since  our  last  report,  we  have  made  progre.ss  on  two  fronts.  Tapia 
has  been  working  with  visitors  to  the  NSF  Center  for  Research  on  Parallel  Computation  on 
interior-point  methods  for  linear  programming.  They  have  found  a  method  with  the  be.st 
known  iteration  complexity  as  well  as  the  be.st  known  asymptotic  rate  of  convergence.  There 
are  several  other  reports  in  preparation  on  interior-point  methods  as  well. 

Tapia  and  visitor  Gonzaga  from  Brazil  successfully  completed  two  manuscripts.  The 
first  paper  demonstrates  the  quadratic  convergence  of  a  primal-dual  algorithm  for  linear 
programming.  The  existence  of  such  an  algorithm  and  the  coiresponding  proof  of  quadratic 
convergence  has  been  an  important  open  question  that  has  received  attention  in  the  last  few 
years.  The  second  manuscript  is  concerned  with  demonstrating  that  a  particularly  well-known 
primal-dual  algorithm  converges  to  the  analytic  center  of  the  solution  .set.  Again,  this  issue  had 
been  an  open  question  for  .several  years.  The  solution  of  these  two  open  questions  has  been 
particularly  .satisfying.  Both  papers  have  been  accepted  for  publication  in  the  SIAM  Journal 
on  Optimization. 

Tapia  together  with  Rice  re.searchers  Soren.sen,  and  El-Bakry  and  visitor  Zhang  have 
made  excellent  initial  progress  in  the  construction  of  a  parallel  primal-dual  interior-point 
algorithm  for  linear  programming. 

Tapia  together  with  Rice  postdoc  El-Bakry  and  visitors  Takashi  Tsuchiya  and  Yin 
Zhang  has  initiated  re.search  in  the  area  of  extending  the  primal-dual  interior-point  algorithms 
from  linear  programming  to  general  nonlinear  programming.  Limited  experimentation  has  led 
us  to  believe  that  the  formulation  is  quite  promi.sing. 


Research  on  Optimization  with  Simulation  Constraints 


Professor  Dennis,  Research  Scientist  Michael  Lewis,  and  some  colleagues  at  Rice  and 
at  Boeing  Corporation  have  discovered  some  novel  ways  to  pose  important  practical  problems 
that  lead  to  very  promising  algorithmic  ideas  suitable  for  parallel  architectures.  The  class  of 
problems  being  considered  is  the  optimization  of  a  nonlinear  objective  subject  to  nonlinear 
differential  equations  constraints,  especially  ca.ses  where  there  are  coupled  differential 
equations  of  different  type.s.  For  example,  the  aircraft  indusmy  is  interested  in  this  problem  in 
the  case  of  optimal  airfoil  design  where  one  constraint  is  a  system  of  partial  differential 
equations  that  determine  the  pressure  pattern  on  a  wing  of  a  certain  shape  caused  by  the  air 
flowing  across  it  at  a  certain  speed  and  angle  of  attack;  another  constraint  is  a  .system  of 
differential  equations  whose  solution  conecLs  the  shape  of  the  airfoil  given  a  pressure  pattern. 

Traditional  ‘black-box'  methods  require  the  designer  to  resolve  the  coupled  system 
consisting  of  both  .systems  of  differential  equations  before  the  optimization  method  is  allowed 
to  increment  the  basic  shape  parameters  of  the  airfoil  to  improve  the  design  objective. 
Furthermore,  finite  differences  are  generally  u.sed  to  compute  the  ‘.system  .sensitivities'.  These 
require  a  complete  resolution  of  the  coupled  system  for  each  design  variable! 

Our  approach  is  very  different.  In  this  particular  instance,  we  uncouple  the  two 
constraints  by  allowing  the  nonlinear  programming  algorithm  to  control  as  optimization 
variables  the  pre.ssure  pattern  input  to  the  structural  analysis  code  and  the  shape  input  to  the  cfd 
code.  We  resolve  this  inconsistency  only  in  the  limit  as  optimality  is  approached  by  adding  to 
the  nonlinear  programming  formulation  of  the  problem  constraints  that  the  structures  and  cfd 
codes  match  input  and  outputs  with  each  other. 

In  joint  work,  we  have  developed  and  analyzed  a  new  nonlinear  programming 
algorithm  that  u.ses  only  iterative  methods  with  no  matrix  factorizations.  This  is  veiy  important 
for  the  design  and  control  problems  mentioned  above  becau.se  of  the  size  of  the  nonlinear 
programming  problems  that  result  from  reali.stic  di.scretizations  of  tho.se  problem.s.  Lewis  has 
successfully  used  this  algorithm  to  .solve  for  1024  coefficients  of  hydrolic  conductivity  for 
inverse  transmissivity  on  a  .^2x.^2x64  grid  using  a  4x4x4  Glowinski  &  Wheeler 
nonoverlapping  domain  decomposition. 

This  involved  roughly  4.T(HK)  variables  and  42,(K)0  constraints.  The  computation  w  is 
done  using  64  nodes  of  the  Intel  Touch.stone  Delta  in  time  roughly  equivalent  to  250  forward 
.solves  of  the  tran.smi.ssivity  equation.  Thus,  a  traditional  technique  based  on  finite  difference 
gradients  and  a  complete  forward  .solution  of  the  differential  equation  for  each  parameter  .set 
would  not  even  have  been  25%  of  the  way  through  the  initial  gradient  calculation  when  our 
method  finished  the  entire  problem! 
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Reseaich  on  Large  Scale  Nonlinear  Methods 


Dennis  has  heen  working  with  a  graduate  student  and  researchers  in  the  NSF  center  on 
a  generalization  of  the  Brown-Brent  methods  tor  large-scale  problems.  These  methods  can  he 
thought  of  as  heiween  traditional  SQP  and  GRG  approaches.  Our  work  is  motivated  by 
parameter  id  and  control  for  systems  governed  by  differential  equations.  This  work  has 
resulted  in  a  thesis  written  by  Natalia  Alexandrov  (a  US  citizen  despite  the  name.) 


Research  on  Parallel  Direct  Search  Methods 


» 


Research  Scientist  Virginia  Torczon  and  Dennis  have  developed  an  extremely  robust 
direct  search  method  that  can  be  used  on  any  number  of  processors  with  any  ratio  of 
computation  costs  to  communication  costs.  This  method  has  been  tested  on  the  Sequent 
Symmetry,  the  iPSC/86()  hypercube,  and  the  iPSC  Delta.  This  work  was  begun  under  ARO 
sponsorship  in  the  PhD  thesis  of  Dr.  Virginia  Torczon. 

There  have  been  some  vei^  gratifying  industrial  applications  of  this  work.  At  Boeing 
Aircraft  Company,  there  is  a  llexible  manufacturing  facility  that  receives  orders  each  day  to 
stamp  out  certain  aircraft  parts  from  sheet  metal.  This  stock  is  very  expensive,  and  so  it  is 
important  to  be  able  to  layout  the  parts  as  efficiently  as  possible  in  order  to  minimize  the  trim 
loss. 


Previously,  Boeing  leased  a  computer  and  commercial  software  to  solve  this  problem 
for  the  day's  order.  Dr.  Thomas  Grandine  and  Dr.  Samuel  Eldersveld  of  Boeing  Computer 
Services,  implemented  the  Multidirectional  Search  Algorithm,  inside  a  “nesting”  code. 
“Ne,sting”  is  the  Boeing  word  for  this  problem.  The  multidirectional  search  algorithm  is  now 
solving  an  important  two  variable  subproblem  that  arises  in  the  inner  most  loop  of  their  code. 
Not  only  do  their  preliminai^  tests  indicate  that  they  will  see  significant  reductions  in  time  and 
material,  but  they  have  also  been  able  to  replace  a  commercial  code  imnning  on  an  expensive 
leased  machine  with  their  new  code  running  on  a  standard  Sparc  workstation— at  significant 
.savings  to  the  company. 

General  Electric  has  also  infonued  us  that  they  have  imbedded  the  algorithm  in  .some  of 
their  design  software  where  it  is  u.sed  to  .solve  a  low  dimensional  noi.sy  search. 


